Yule ’ s “ Nonsense Correlation ” Solved !

نویسنده

  • PHILIP ERNST
چکیده

In this talk, I will discuss how I recently resolved a longstanding open statistical problem. The problem, formulated by the British statistician Udny Yule in 1926, is to mathematically prove Yule's 1926 empirical finding of "nonsense correlation". We solve the problem by analytically determining the second moment of the empirical correlation coefficient of two independent Wiener processes. Using tools from Fredholm integral equation theory, we calculate the second moment of the empirical correlation to obtain a value for the standard deviation of the empirical correlation of nearly .5. The "nonsense" correlation, which we call "volatile" correlation, is volatile in the sense that its distribution is heavily dispersed and is frequently large in absolute value. It is induced because each Wiener process is "selfcorrelated" in time. This is because a Wiener process is an integral of pure noise and thus its values at different time points are correlated. In addition to providing an explicit formula for the second moment of the empirical correlation, we offer implicit formulas for higher moments of the empirical correlation The full paper was recently published in The Annals of Statistics and can be found at https://projecteuclid.org/euclid.aos/1498636874

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Noise-compensated Long Correlation Matching Method for Ar Spectral Estimation of Noisy Signals

A noise-compensated long correlation matching (NCLCM) method is proposed for autoregressi~e ~AR) spectral estimation of the noisy AR signals. This method first computes the AR parameters from the high-order "(ule-Walker equations. Next, it employs these AR parameters and uses the low-order Yule-Walker equations to compensate the zeroth autocorrelation coefficient for the additive white noise. F...

متن کامل

On the distribution of interspecies correlation for Markov models of character evolution on Yule trees.

Efforts to reconstruct phylogenetic trees and understand evolutionary processes depend fundamentally on stochastic models of speciation and mutation. The simplest continuous-time model for speciation in phylogenetic trees is the Yule process, in which new species are "born" from existing lineages at a constant rate. Recent work has illuminated some of the structural properties of Yule trees, bu...

متن کامل

Title The Phi - coefficient , the Tetrachoric Correlation Coefficient , and the Pearson - Yule Debate

Two measures of association for dichotomous variables, the phi-coefficient and the tetrachoric correlation coefficient, are reviewed and differences between the two are discussed in the context of the famous so-called Pearson-Yule debate, that took place in the early 20th century. The two measures of association are given mathematically rigorous definitions, their underlying assumptions are for...

متن کامل

Effect of Non-Normality on Sampling Plan Using Yule’s Model

In this paper, the effect of non-normality on sampling plan using Yule’s model (second order auto regressive model {AR (2)}) represented by the Edgeworth series is studied for known $sigma$. The effect of using the normal theory sampling plan in a non-normal situation using Yule’s model is studied by obtaining the distorted errors of the first and second kind. As one will be interes...

متن کامل

Comparison of Parametric and Non-parametric EEG Feature Extraction Methods in Detection of Pediatric Migraine without Aura

Background: Migraine headache without aura is the most common type of migraine especially among pediatric patients. It has always been a great challenge of migraine diagnosis using quantitative electroencephalography measurements through feature classification. It has been proven that different feature extraction and classification methods vary in terms of performance regarding detection and di...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016